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Introducing  Actions  into  Qualitative  Simulation 


Abstract 

Many  potential  uses  of  qualitative  physics,  such  as  robot  planning  and  intelligent 
computer-aided  engineering,  require  integrating  physics  with  actions  taken  by  agents.  This 
paper  proposes  to  augment  qualitative  simulation  to  include  the  effects  of  actions  to  form 
action-augmented,  envisionments.  The  action-augmented  envisionment  incorporates  both 
the  effects  of  an  agent’s  actions  and  what  will  happen  in  the  physical  world  whether  or 
not  the  agent  does  something.  Consequently,  it  should  provide  a  richer  basis  for  planning 
and  procedure  generation  than  any  previous  representation.  This  paper  defines  action- 
augmented  envisionments  and  an  algorithm  for  directly  computing  them,  along  with  an 
analysis  of  its  complexity  and  suitability  for  different  kinds  of  problems.  We  describe  our 
initial  implementation  and  discuss  potential  extensions,  including  incremental  algorithms. 

Keywords:  Qualitative  reasoning,  planning,  artificial  intelligence. 
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1  Introduction 

Many  tasks  require  predicting  both  the  effects  of  changes  in  the  physical  world  and  the 
consequences  of  taking  actions.  A  robot  which  makes  tea,  for  instance,  must  enlist  physical 
processes  such  as  liquid  flow  and  boiling  to  carry  out  its  plan.  An  intelligent  CAD  tool  for 
power  plant  design  must  be  able  to  reason  about  the  effects  of  actions  taken  by  operators 
of  the  plant  in  order  to  design  a  safe  system.  Yet  little  work  to  date  has  addressed  the 
issue  of  integrating  a  qualitative  physics  with  representations  of  actions. 

One  way  to  integrate  physics  with  action  is  to  move  the  physics  into  the  planner. 
Hogge  [12]  has  developed  an  domain  compiler  that  takes  QP  domain  models  and  produces 
rules  and  operators  suitable  for  a  temporal  planner.  Given  a  goal  like  “Increase  the  water 
level  in  this  container”,  his  planner  can  use  the  knowledge  of  actions,  combined  with 
rules  and  “operators”  representing  what  the  physical  world  will  do  derived  from  the  QP 
model,  to  figure  out  that  it  should  place  the  container  under  a  faucet  and  turn  on  the  tap. 
Unfortunately,  many  oversimplifications  are  required  to  keep  the  compilation  tractable1. 
Furthermore,  adding  more  run-time  knowledge  to  overcome  this  and  other  problems  makes 
the  temporal  planner  bog  down  [13,14].  For  example,  Hogge’s  original  planner  could  figure 
out  how  to  get  water  into  an  empty  pot  and  how  to  make  water  in  a  full  pot  boil,  but 
without  adding  run-time  transitivity  rules  it  could  not  compose  these  plans  to  fill  an  empty 
pot  with  boiling  water.  With  transitivity  rules,  the  planner  would  exceed  machine  resource 
limitations  before  finding  the  solution.  While  worth  continued  exploration,  the  difficulty  of 
reconstructing  the  entire  framework  of  qualitative  simulation  into  rules  suitable  for  efficient 
planning  makes  exploring  alternatives  worthwhile. 

Here  we  explore  the  dual  approach:  Moving  actions  into  the  physics.  The  next  section 
introduces  a  new  representation,  the  action-augmented  envisionment  (or  AS),  which  inte¬ 
grates  the  results  of  qualitative  simulation  with  the  effects  of  an  agent’s  actions.  Section  3 
describes  an  algorithm  for  computing  AS' s  directly,  and  Section  4  analyzes  its  complexity 
and  potential  suitability  for  two  tasks,  robot  planning  and  procedure  generation  in  engi¬ 
neered  systems.  Section  5  describes  the  state  of  our  implementation.  Finally,  we  describe 
our  plans  for  future  work. 

2  Action- Augmented  Envisionments 

Let  us  re-consider  what  qualitative  states  are.  We  will  use  Hogge’s  problem  of  figuring  out 
from  first  principles  how  to  boil  water  as  an  example  in  the  rest  of  this  paper.  Informally,  a 
qualitative  state  describes  a  class  of  particular  behaviors  for  a  physical  system.  Qualitative 
states  are  linked  by  transitions,  which  describe  how  these  gross  behaviors  can  change.  For 
instance,  if  we  have  a  pot  of  water  on  an  operating  stove,  one  state  is  that  the  water  is 
heating  up,  and  another  state  is  that  the  water  is  boiling.  These  states  have  a  transition 

iFor  instance,  the  compiler  assumes  that  if  you  influence  a  quantity  in  a  particular  direction  it  will 
actually  change  that  way.  Thus  the  planner  would  believe  that  one  could  bail  out  a  sinking  ocean  liner  with 
a  teaspoon. 
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Figure  1:  QP  descriptions  can  be  sensitive  to  the  effects  of  actions 
In  the  description  of  heat  flow  below,  the  truth  of  HEAT-ALIGNED  depends  on  the  location 
of  the  objects  involved.  Actions  which  change  location  indirectly  affect  whether  or  not  this 

process  can  occur,  as  illustrated  by  the  laws  on  the  bottom. 

Process  Heat-Flow(?src , ?dst , ?path) 

Individuals:  ?src,  Quantity (heat (?src) ) 

?dst ,  Quantity (heat (?dst) ) 

?path,  Heat-Path(?src , ?dst) 

Preconditions :  Heat-Aligned(?path) 

Quantity  Conditions:  A[T(?src)]  >  A[T(?dst)] 

Relations:  Quantity (flow-rate) 

flow-rate  =  T(?src)  -  T(?dst) 

Influences:  1+ (heat (?dst) , A [flow-rate] ) 

I- (heat (?src) ,A[f low-rate] ) 

V  ?c,?s  Contained-Stuf f (?c)  A  Location(Container(?c))=On(?s)  =>•  Heat-Path(?s , ?c) 

V  ?c  Contained-Stuf  f  (?c)  =>■  Heat-Aligned(?c) 

Knob  (Stove)  =0N  =>■  Heat-Aligned(Stove) 

V  ?x,?y  Heat-Path(?x , ?y)  A  Heat-Aligned(?x)  A  Heat-Aligned(?y) 

=>  Heat-Aligned(Heat-Path(?x,?y)) 


between  them,  whose  condition  is  that  the  temperature  of  the  water  reaches  its  boiling 
temperature.  Qualitative  simulation  consists  of  computing  these  states  and  transitions. 

Every  qualitative  simulation  leaves  some  “background  information”  unchanged.  We  do 
not,  for  example,  consider  what  the  world  would  look  like  if  the  stove  suddenly  vanished  in 
the  scenario  above.  In  fact,  qualitative  simulations  focus  on  just  those  changes  predictable 
solely  within  whatever  physics  is  being  used.  The  complete  set  of  states  and  transitions  for 
some  fixed  set  of  background  assumptions  is  the  envisionment  for  that  scenario.  (When 
needed,  we  will  use  the  conventions  of  [10,3,16,17]  to  describe  envisionments  and  their 
components.)  To  capture  the  effects  of  actions,  we  must  allow  at  least  some  of  the  back¬ 
ground  assumptions  to  vary.  In  the  scenario  above,  for  instance,  we  would  like  to  capture 
the  fact  that  switching  the  stove  on  will  initiate  the  heat  flow,  and  that  moving  the  pot  to 
a  table  will  break  thermal  contact,  and  thus  end  the  heat  flow. 

A  necessary  prerequisite  for  this  extension  is  that  the  qualitative  physics  be  sensitive 
to  changes  in  background  assumptions.  Qualitative  Process  theory  [6]  provides  two  forms 
of  explicit  representation  of,  and  hence  dependence  on,  background  assumptions.  First, 
QP  descriptions  specify  the  kinds  of  individuals  they  apply  to.  Heat  flow,  for  instance, 
can  occur  between  any  two  objects  which  are  modeled  as  having  thermal  properties,  and 
which  have  some  kind  of  thermal  path  connecting  them.  Second,  QP  descriptions  can 
depend  upon  explicit  preconditions  that  further  restrict  their  applicability.  For  instance, 
one  might  consider  the  burner  of  a  stove  to  be  a  heat  path  which  is  usable  only  when  the 
stove  is  switched  on  (see  Figure  1).  Consequently,  we  use  QP  theory  as  our  basis. 

As  indicated  above,  we  do  not  typically  consider  every  possible  change  in  background 
assumptions.  Call  the  set  of  background  assumptions  for  a  scenario  P .  The  subset  of  P 
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which  should  be  varied  is  exactly  that  part  which  could  be  changed,  directly  or  indirectly, 
by  the  action  of  some  agent.  We  call  these  the  manipulable  assumptions  of  P ,  or  Pm. 
Clearly,  Pm  will  depend  on  the  set  of  operators  used  to  model  an  agent’s  actions,  and  the 
laws  which  allow  the  effects  of  those  operators  to  be  inferred. 

In  typical  qualitative  physics  systems,  Pm  is  empty.  That  is,  the  envisionment  £  is  taken 
with  respect  to  fixed  P,  which  we  can  denote  £  (P).  Let  P^  be  the  consistent  combinations 
of  Pm,  and  Pf  be  the  set  of  fixed  background  assumptions  (i.e. ,  P  —  Pm).  Then  the  set  of 
states  in  an  action-augmented  envisionment  AS  is  just 

States(A£)  =  IJ  £(pUPf) 

Pe?m 

Since  standard  envisionments  contain  transitions  due  to  changes  predicted  within  the 
physics,  we  assume  the  collection  States(A£ )  constructed  so  far  inherits  them  intact.  Now 
we  must  extend  the  set  of  transitions  to  include  the  occurrences  of  actions.  We  do  this 
by  analogy  to  the  QP  definition  of  state  transitions.  In  QP  theory,  state  transitions  are 
represented  as  instances  of  limit  hypotheses,  potential  changes  in  inequality  relationships 
brought  about  by  the  direct  and  indirect  effects  of  physical  processes.  The  hypothesis 
that,  for  instance,  the  temperature  of  the  water  in  the  pot  might  reach  its  boiling  tem¬ 
perature  would  be  applicable  to  any  situation  where  the  water  is  being  heated,  regardless 
of  the  heat  source  involved.  Similarly,  we  call  an  action  hypothesis  the  conjecture  that 
a  particular  action  occurs.  In  thinking  about  the  stove,  for  instance,  the  operator  in¬ 
stance  Move-to(Potl  ,0n(Stove))  might  occur  in  a  number  of  states.  Each  conjectured 
occurrence  is  an  action  hypothesis. 

We  place  several  restrictions  and  constraints  on  transitions  caused  by  action  hypotheses. 
For  simplicity,  we  make  the  following  restrictions: 

1.  Single  action  assumption:  At  most  one  action  can  be  taken  at  a  time. 

2.  Seperation  assumption:  Actions  do  not  coincide  with  state  transitions  introduced  by 
the  physics. 

The  single  action  assumption  loses  no  generality,  since  the  vocabulary  of  operators 
could  always  include  compound  operations.  An  important  consequence  of  the  seperation 
assumption  is  that  actions  cannot  occur  in  states  which  the  dynamics  predicts  will  only 
last  an  instant.  Unfortunately,  it  does  potentially  restrict  the  expressibility  of  A£ s.  To 
hold,  actions  must  be  considered  to  occur  quickly,  relative  to  physical  changes.  For  many 
circumstances  this  assumption  is  not  onerous;  for  instance,  the  temperture  of  water  in 
a  kettle  doesn’t  drop  appreciably  in  the  time  it  takes  to  move  the  kettle  from  the  stove 
to  a  teapot.  Also,  in  many  cases  where  actions  do  take  appreciable  time  (such  as  slowly 
opening  a  valve  in  a  heating  system)  this  limitation  could  be  surmounted  by  modeling  the 
action  as  a  sequence  of  instantaneous  actions  or  reifing  it  as  a  continuous  changes  in  the 
physics  triggered  by  actions. 

An  action  hypothesis  Ay  can  be  viewed  as  a  function  whose  domain  and  range  are  P£. 
Let  P ^  =  Ay(P^).  Given  a  qualitative  state  Si  in  which  P ^  holds,  for  S2  to  be  a  possible 
result  of  Ay  on  Si,  it  must  satisfy  the  following  restrictions: 
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1.  Consistency:  holds  in  S 2. 

2.  Continuity:  When  possible,  no  violations  of  continuity  occur  between  Si  and  S2. 

3.  Closeness:  No  state  also  considered  to  be  a  possible  result  of  Ay  on  Si  has  more  in 
common  with  Si  than  S 2  does. 

The  consistency  restriction  is  obvious.  The  continuity  and  closeness  restrictions  express 
the  desiderata  that,  besides  the  necessary  indirect  consequences  of  the  action,  nothing 
else  should  change  as  a  result  of  it.2  All  reasonable  interpretations  of  closeness  imply 
continuity,  but  it  is  worth  mentioning  explicitly  because  it  is  a  useful  filter.  Unfortunately, 
continuity  cannot  always  be  satisfied.  Consider  a  situation  where  the  pressure  in  a  boiler 
is  rising  dangerously,  and  safety  valve  is  popped  open  to  bleed  off  excess  steam.  The  result 
of  opening  the  valve  can  most  easily  be  modeled  by  a  discontinuous  change  where  the 
pressure  in  the  boiler  is  dropping3.  There  are  several  ways  to  define  closeness,  depending 
on  the  details  of  the  qualitative  physics  and  simulation  strategy.  A  particular  measure  of 
closeness  for  envisioning  in  QP  theory  is  described  in  the  next  section. 

3  An  Algorithm  for  constructing  A£ s 

This  algorithm  for  computing  A£s  is  based  on  the  representations  used  in  the  Qualitative 
Process  Engine  (QPE)  [9].  Since  QPE  is  based  on  an  ATMS  [4],  and  the  formulation  of 
A£s  is  based  on  describing  different  sets  of  assumptions,  our  algorithm  will  be  particularly 
simple.  In  what  follows  we  exploit  the  fact  that  a  particular  situation  in  QPE  is  defined 
by  a  set  of  assumptions  Sa  =  Q.  a  U  Ps,  where  Qs  are  drawn  from  the  set  of  possible 
inequality  assumptions  and  Ps  are  drawn  from  P.  Explicit  temporal  notations,  such  as 
situation  markers  or  slices,  are  not  used.  Rather,  the  temporal  scoping  of  facts  is  implicit 
in  their  ATMS  label.  Thus  we  would  determine  if  Location(Potl)  =  On(Stove)  held  in 
a  situation  by  checking  to  see  if  that  fact  was  implied  by  the  assumptions  defining  the 
situation.  This  allows  us  to  compactly  represent  a  large  number  of  situations,  and  apply 
consequences  of  rules  as  widely  as  possible. 

For  simplicity  we  choose  the  STRIPS  representation  for  actions.  While  less  expressive 
than  other  action  representations  (e.g.  [1,18,19]),  it  easily  satisfies  the  single  action  and 
seperation  assumptions.  To  adapt  this  representation  to  QPE,  we  require  all  facts  mentioned 
in  the  add  lists  and  delete  lists  of  operator  instances  to  be  in  Pm. 

Given  a  domain  model,  which  specifies  the  particular  physical  theory  to  be  used,  and 
a  scenario,  specified  by  Pf,  QPE  expands  the  scenario  by  applying  the  abstractions  of  the 
domain  model.  This  creates  instances  of  views,  processes,  and  derived  objects  (such  as 
“water  in  the  pot”).  It  is  easy  to  extend  this  process  to  include  finding  operator  instances, 
and  to  automatically  accumulate  Pm.  Since  QPE  can  search  variations  in  Ps  as  well  as 
Qs,  States{A£) is  computed  via  the  standard  envisioning  procedure.  Furthermore,  since 

2 The  existence  of  indirect  consequences  of  actions  are  why  generally  S2  —  Pm  7^  Si  —  Pm- 

3  It  would  be  possible  to  preserve  continuity  by  introducing  another  state  where  Ds  [P]  =  0,  but  since  this 
state  serves  no  other  purpose  it  seems  inefficient  to  do  so. 
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Figure  2:  Operators  for  the  kitchen  domain 
def Operator  Move-To (?f rom, ?thing, ?to) 

Individuals:  ?from,  Place (?f rom) 

?thing,  Mobile (?thing) 

?to,  Place  (?thing)  A  ?from  A  ?to 
Delete-List:  Location(?thing)  =  ?from 
-i  Clear(?from) 

Clear (?to) 

Add-List:  Location(?thing)  =  ?to 

-i  Clear(?to) 

Clear (?from) 

def Operator  Flip(?switch, ?from, ?to) 

Individuals:  ?switch,  Switch(?f rom) 

?from,  Has-Setting(?switch, ?from) 

?to,  Has-Setting(?switch,?to)  A  ?from  A  ?to 
Delete-List:  ?switch  =  ?from 
Add-List:  ?switch  =  ?to 


we  have  the  operator  instances  we  can  create  the  set  of  Ax’s.  All  that  remains  is  (l)  to 
ascertain  when  these  Ax’s  are  applicable  and  (2)  to  determine  their  effect  in  each  case. 

Consider  again  the  operators  in  Figure  2.  We  will  refer  to  the  assumptions  correspond¬ 
ing  to  the  delete  list  and  add  list  of  an  operator  instance  as  Ax  and  Ajf,  respectively.  To 
determine  if  an  operator  instance  0,  can  apply  to  a  situation  Si, 

1.  Unless  Individuals(Oi)  are  implied  by  Si,  fail. 

2.  Let  P's  =  (  Ps-  Ax)  +  Ay.  If  P'  is  inconsistent,  fail. 

To  complete  the  test  we  must  find  out  if  P'  can  be  extended  into  a  consistent  situation 
S2  G  States(AS).  Otherwise,  we  consider  the  action  inapplicable. 

Since  we  already  have  States(A£),  finding  the  results  of  0,-  on  Si  can  be  viewed  as  a 
filtering  problem  whose  result  is  the  set  C.  One  algorithm  is: 

1.  Let  Ci  =  {Sj  G  States(AS)  \  P'  C  Sj} 

2.  Let  C2  be  the  subset  of  Ci  which  do  not  violate  continuity,  when  viewed  with  respect 
to  Si.  If  C2  is  empty,  C2=  C\. 

3.  Let  C  =  {Sj  G  C2  |  flSk  G  C2  s.t. \  Sk  D  Si  \  >  \  Sj  D  St-  |} 

The  first  step  provides  our  initial  candidates  by  enforcing  consistency,  and  the  second 
uses  the  same  continuity  pruning  used  for  limit  analysis  in  QPE  (see  [9]  for  details).  The 
final  step  provides  a  precise  definition  for  the  notion  of  closeness  described  before  -  in  this 
algorithm,  it  is  literally  the  number  of  assumptions  shared  with  the  previous  situation. 
For  each  Sj  G  C,  the  set  Transitions{A£ )  is  extended  to  include  a  transition  from  Si  to 
Sj,  justified  by  0,-. 
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Typically  an  action  will  result  in  a  unique  next  state.  Unfortunately,  this  will  not 
always  be  the  case,  due  to  the  ambiguity  of  qualitative  representations.  Consider  again 
the  boiler  with  relief  valve.  Once  the  relief  valve  blows  there  will  be  ambiguous  influences 
on  the  pressure  -  the  flow  out  through  the  relief  valve  will  act  to  decrease  it,  while  the 
generation  of  more  steam  will  act  to  increase  it.  Consequently,  the  pressure  could  continue 
to  increase,  decrease,  or  remain  constant,  and  so  unless  extra  knowledge  can  disambiguate 
them,  each  is  a  legitimate  consequence  of  that  action. 

4  Analysis 

Our  analysis  addresses  three  questions:  (l)  What  is  the  complexity  of  explicitly  generating 
A£7  (2)  Under  what  circumstances  would  explicit  generation  make  sense?  (3)  Could  AS 
be  generated  incrementally? 

4.1  Complexity  of  the  algorithm 

The  first  question  can  be  divided  into  two  parts:  (l)  Given  that  the  standard  envisioning 
process  can  compute  States(AS),  how  complicated  is  the  additional  step  of  generating  A^ s 
and  determining  their  consequences,  and  (2)  How  much  does  it  cost  to  generate  States(AS) 
relative  to  a  standard  envisionment  £  (i.e. ,  where  Pm  is  empty). 

Finding  operator  instances  is  easy.  The  worst-case  complexity  for  each  operator  is 
0  (i*)  ,  where  t  is  the  number  of  specifications  in  the  operator’s  individual  field  and  i  is  the 
number  of  individuals  in  the  scenario.  Clever  indexing  on  individual  types,  along  with  the 
fact  that  t  tends  to  be  small  (around  3),  makes  this  step  trivial.  Notice  that  this  result  does 
not  depend  on  the  number  of  situations,  an  advantage  conferred  by  the  implicit  temporal 
reference  scheme. 

We  assume  the  ATMS  is  arranged  so  that  tests  for  logical  implication  and  consis¬ 
tency  of  a  set  of  assumptions  are  constant-time  operations  (they  typically  are).  Let 
n  =  |  States(AS)  |.  Then  finding  whether  or  not  operator  instance  Oi  may  apply  in  a 
particular  situation  takes  a  constant-time  test  for  implication,  and  time  linear  in  the  num¬ 
ber  of  assumptions  to  produce  P'.  This  cost  is  roughly  constant  over  all  situations,  and 
depends  on  the  average  number  of  assumptions  in  a  situation.  This  number  is  relatively 
small  compared  to  the  number  of  situations  which  can  be  generated  from  them,  hence  we 
consider  it  constant.  Finding  the  initial  candidate  set  C\  is  also  linear  in  n,  so  we  are  now 
bounded  by  0(n2)  .  The  continuity  computation  and  the  computation  of  C  from  C 2  are 
combinations  of  linear  time  operations,  so  the  cost  of  adding  action  transitions  is  0(n2)  . 

What  is  the  cost  of  computing  States{A£ )  relative  to  £7  The  complexity  of  QPE’s 
algorithm  is  still  being  established,  so  we  must  content  ourselves  with  asking  about  the 
size  of  States(A£ )  relative  to  States{£),  which  depends  on  the  size  of  P£.  Suppose  Pm 
consists  of  pairs  of  propositions  p  and  ->p,  and  these  assumptions  are  independent.  Then 
an  upper  bound  for  the  worst-case  increase  in  the  number  of  states  is  a  factor  of  2 1  I-1. 

So  the  signficant  cost  lies  not  in  temporal  inheritance,  but  in  generating  the  states  in  the 
first  place. 
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4.2  When  would  explicit  generation  make  sense? 

It  is  generally  foolhardy,  and  typically  impossible,  to  explicitly  generate  an  entire  problem 
space.  Yet  that  is  exactly  what  envisioning  does,  and  the  algorithm  above  relies  on  it. 
How  close  we  come  to  worst-case  performance  depends  on  the  interactions  between  the 
operator  vocabulary  and  the  rest  of  the  domain  model.  If  the  operators  are  completely 
irrelevant  to  the  domain  model,  then  |  States(AS)  \  =  I  K  I  x  |  States(£)  |.  But  generally 
they  interact,  and  only  a  small  subset  of  the  cross  product  is  consistent.  A  domain  where 
the  dynamical  behavior  is  complex,  but  the  number  of  actions  which  can  be  taken  is  small, 
would  be  the  best  case. 

The  problem  of  procedure  generation  for  engineered  systems  may  be  just  such  a  problem. 
Consider  a  power  plant  (either  stationary  or  onboard  a  ship).  Its  dynamical  state  can 
be  complex,  and  a  badly-timed  action  can  result  in  disaster.  But  the  kind  of  actions 
an  operator  can  take  are  generally  limited  to  flipping  switches  and  opening  or  closing 
valves.  Since  an  A£  compactly  represents  the  result  of  executing  all  possible  plans,  it 
could  be  useful  in  generating  operating  procedures  and  safety  analyses.  To  deal  with 
realistic  systems  will  require  the  same  decomposition  stratagies  as  traditional  engineering. 
For  instance,  procedures  for  a  system  are  typically  generated  by  combining  procedures  for 
subsystems.  This  suggests  computing  A£’s  for  subsystems  independently  and  combining 
their  results. 

4.3  Incremental  generation 

Typical  “robot  planning”  domains  are  the  worst  kind  of  task  for  explicit  A£  generation, 
since  includes  each  location  for  each  moving  object,  and  thus  could  be  huge.  Incre¬ 
mental  algorithms  would  be  better,  and  appear  both  possible  and  feasible.  The  A£  is 
just  a  problem  space,  whose  operators  are  the  actions  which  can  be  taken  plus  the  set  of 
limit  hypotheses.  Incremental  temporal  inheritance  algorithms  for  QP  theory  exist  [8,7], 
and  could  easily  be  extended  to  Ay s.  The  entire  panoply  of  AI  search  strategies  could 
potentially  be  used  to  generate  plans.  However,  the  fact  that  some  transitions  will  occur 
whether  or  not  the  agent  desires  them  changes  the  nature  of  the  problem  somewhat. 

One  way  to  view  planning  in  the  A£  problem  space  is  as  playing  a  game  with  Nature. 
The  agent  controls  actions,  and  Nature  controls  dynamics.  This  view  is  not  exact,  of 
course,  since  Nature  is  not  generally  held  to  have  goals4  and  the  “players”  in  this  game 
don’t  take  strict  turns.  Nevertheless,  the  metaphor  is  suggestive.  For  example,  there  is 
a  “horizon  effect”  in  this  problem  space  which  consists  of  dynamical  changes  undoing  a 
state  achieved  by  the  agent.  To  assure  that  the  intended  effect  of  the  action  is  maintained, 
qualitative  simulation  can  be  used  to  see  if  either  (a)  no  dynamical  transitions  occur  or 
(b)  they  take  sufficiently  long  that  the  next  action  can  be  performed  before  they  occur. 

4Although  Murphy’s  Law  is  tantamount  to  assuming  that  Nature  is  playing  to  win,  i.e.,  to  thwart  the 
agent’s  goals  if  possible. 


August,  1988 


9 


5  An  implemenation 

We  have  implemented  the  algorithm  described  in  Section  3,  and  have  tested  it  on  one 
example  at  this  writing.  Here  is  the  scenario:  Consider  a  kitchen  containing  a  table,  a 
faucet,  a  stove,  and  a  movable  pot.  The  faucet  is  an  infinite  supply  of  water,  and  the  stove 
is  an  infinite  supply  of  heat,  exactly  when  their  respective  knobs  are  ON  (viz.  Figure  1). 
Our  goal  is  to  have  boiling  water  in  the  pot.  The  process  vocabulary  includes  heat  flow, 
liquid  flow,  and  boiling  [6],  and  the  actions  are  those  shown  in  Figure  2. 

Here  are  the  highlights  of  the  AS  created  for  this  scenario.  There  are  244  situations, 
with  1054  transitions  between  them  (78  due  to  dynamics,  the  rest  due  to  actions).  QPE 
automatically  divides  situations  into  equivalence  classes  for  summarization,  and  in  this 
description  there  are  only  21  states,  with  76  transitions  between  them  (10  due  to  dynamics). 
The  summaries  for  the  standard  envisionment,  action  transitions,  and  full  AS  are  plotted 
in  figure  3.  In  terms  of  the  analysis  presented  earlier,  this  result  is  encouraging  -  this  is  a 
“worst-case”  problem,  after  all.  For  this  problem,  |  States(S  (Pf))  |  =  25,  and  there  are  12 
binary  choice  sets,  and  one  set  with  three  choices  (i.e.,  the  location  of  the  pot).  Thus  the 
worst  case  would  have  been 

|  States(AS)  |  =  25  x  212  x  3  =  307,200 

This  ilustrates  that  simple  combinatorial  analyses  can  be  misleading  in  highly  constrained 
situations  -  the  classic  AI  “small  infinity”  phenomena. 

A  simple  graph-search  planner  was  built  to  find  plans  given  a  start  state,  goal,  and 
A  £ .  This  A  £  does  indeed  contain  many  correct  plans  for  boiling  water  (see  figure  4) ,  and 
careful  examination  has  revealed  no  unexpected  oddities.  Currently  we  are  developing  a 
series  of  test  cases  to  ensure  our  closeness  requirement  is  sufficient.  If  it  is  not,  then  we 
suspect  that  p-components  [6]  will  be  required  to  narrow  the  subset  of  the  situation  in 
which  violations  of  continuity  are  allowed. 

6  Discussion 

This  paper  proposes  a  method  for  integrating  qualitative  physics  with  models  of  action. 
It  defines  the  action-augmented  envisionment ,  which  compactly  represents  all  predicted 
changes  due  to  a  physics  and  possible  actions  within  a  scenario.  An  algorithm  for  explicitly 
generating  augmented  envisionments  was  presented,  along  with  an  analysis  and  a  report 
on  our  initial  implementation. 

We  believe  this  idea  is  an  important  step  towards  interfacing  qualitative  physics  with 
planning.  Such  understanding  could  lead  to  important  new  applications,  such  as  increased 
automation  of  procedure  generation  and  safety  analyses.  We  suspect  that  for  some  engi¬ 
neering  applications,  the  cost  of  explicit  generation  of  AS' s  may  be  offset  by  the  increased 
confidence  in  the  quality  of  the  answer,  particularly  as  we  discover  how  to  build  multi¬ 
grain  domain  models  [5],  However,  even  if  AS' s  turn  out  to  be  infeasible  to  explicitly 
compute  for  all  but  the  simplest  systems,  we  expect  the  AS  representation  will  be  a  useful 
theoretical  foundation  for  developing  incremental  planning  techniques. 
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Figure  3:  An  Augmented  Envisionment  for  the  Kitchen 
The  top  left  shows  a  summary  of  States(AS)  with  only  the  limit  hypotheses,  and  the  top 
right  shows  the  Ays.  The  bottom  shows  the  combination,  with  a  reasonable  plan  marked. 
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Figure  4:  A  sample  plan  from  the  AS 
Here  is  a  sample  plan  generated  by  graph  search  of  A  S . 

1.  MOVE-TO (ON (COUNTER!.)  , POT, UNDER (FAUCET1))  . 

2 .  FLIP (KNOB (FAUCET1) , OFF , ON) . 

3.  Wait  until  A [AMOUNT-OF-IN (WATER, LIQUID, POT) ]=ZER0  — ►  >. 

4 .  FLIP (KNOB (FAUCET1) , ON , OFF) . 

5.  MOVE-TO (UNDER (FAUCET 1) ,P0T,0N(ST0VE1)) . 

6.  FLIP (KNOB (ST0VE1) , OFF, ON) . 

7.  Wait  until  A [TBOIL (WATER, POT) ]>A [TEMPERATURE (C-S (WATER, LIQUID, POT))] 

8.  Wait  until  A [AMOUNT-OF-IN (WATER, GAS, POT) ]=ZER0  — +  >. 

9 .  FLIP (KNOB (ST0VE1) , ON , OFF) . 

10.  MOVE-TO (ON (ST0VE1) ,P0T,0N(C0UNTER1)) . 


6.1  Future  Work 

We  are  currently  extending  this  work  in  several  ways: 

•  We  are  testing  our  initial  implementation  with  a  variety  of  new  examples,  includ¬ 
ing  subsystems  from  Navy  propulsion  plants  (e.g.,  [15])  and  NASA’s  planned  Space 
Station. 

•  We  are  formalizing  constraints  for  plan  evaluation,  including  efficiency  and  safety. 
These  constraints  will  be  used  to  automatically  select  good  plans  via  graph  search 
from  an  AS ,  and  should  be  useful  in  formulating  incremental  generation  techniques. 

•  A  more  sophisticated  planner  is  needed.  For  example,  the  current  representation  of 
sensing  steps  assumes  that  the  parameter  involved  in  the  transition  can  be  directly 
sensed.  To  construct  executable  plans  requires  integrating  the  ideas  of  measurement 
from  [11]. 

•  We  are  investigating  different  representations  for  duration  to  reduce  the  ambiguity 
in  plan-finding.  An  interesting  possibility  is  to  use  partial  quantiatitive  information, 
as  in  Kuiper  &;  Berleant’s  recent  work  [2]. 

•  Incremental  generation  strategies  require  incremental  qualitative  simulation.  Dennis 
DeCoste  is  designing  an  incremental  version  of  QPE  which  could  be  harnessed  for  this 
purpose. 
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